Random energy levels and low-temperature expansions for spin glasses 
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^ ' In a previous paper (cond- mat/0 106554) we showed the existence of two new zero-temperature 



Q , exponents (A and 9 ) in two dimensional Gaussian spin glasses. Here we introduce a novel low- 

temperature expansion for spin glasses expressed in terms of the gap probabihty distributions for 
successive energy levels. After presenting the numerical evidence in favor of a random-energy levels 
04 ■ scenario, we analyze the main consequences on the low-temperature equilibrium behavior. We find 

that the specific heat is anomalous at low-temperatures c ~ T" with a = —d/6' which turns out to 
. be linear for the case 6' = —d. 

^ , Spin glasses are random systems where frustration plays a very important role. In a previous paper (hereafter 

^ • referred as I)tl we have shown the importance of considering both small and large-scale excitations to properly un- 

, derstand the low-temperature behavior of spin glasses. The thermal exponent 9, which determines the typical free 

■ energy cost to overturn a droplet of large size, scales like with 9 — 9' + dX. The exponent 9' gives the energy cost 
^ ; ' associated to the lowest excitation while the other exponent A has an entropic origin and accounts for the probability 

■ (proportional to to find a large-scale lowest excitation. 

^ In standard phenomenological approaches (domain-wall theory or the droplet modelHcl) the exponent A is not 

I . necessary because only typical excitations are considered for the low-temperature behavior. This case corresponds to 
' ^ ■ A = or, equivalently, 9' = 9. Therefore, the main difference between our approach and the domain- wall approach 
g is that the excitations we consider in our analysis are not typical at finite temperatures while those generated in 
^ ' domain-wall tlieory (by measuring the energy change in the ground state configuration after a twist of the boundary 
I— I [ conditions, seeB) are supposed to be typical. In our approach we infer the statistical properties of the typical excitations 
by looking at those excitations in the extreme tail of the energy gap distribution. The ultimate reason behind the 
validity of our approach is the random character of energy levels. Evidence in favor of a random energy levels scenario 
was already presented in I. In I, besides showing how the exact investigation of the lowest excitations may identify 
the two exponents, we also showed how the gap distribution does not depend on the size of the excitation, justifying 
a scenario of random-energy levels. Here we want to go further and check its validity by extending the analysis to 

■ second order excitations. Furthermore we want to show also how we can derive a novel low-temperature expansion for 
[ spin glasses and infer some results from that expansion by assuming random-energy levels. This expansion is useful to 

' ^ understand the low-temperature behavior of some quantities such as the specific heat or the spin-glass susceptibility. 

Although the main results here and in I only considered 2D Gaussian spin glasses we have founded reasons to 
believe that the validity of our assumptions extends also to higher dimensions. To validate this new scenario beyond 
two dimensions we need systematic and powerful algorithms to look for low-ljang excitations. Recent numerical 
^ , developments promise a fast growth of this area and studies in 3D will be crucialH. 
'"^ ■ The random-energy levels scenario is based on two assumptions. Assumption A: correlations between different 
', energy gaps vanish in the L — > cxd limit and Assumption B: Correlations between excitation volumes Vi and gaps 
O Ei vanish in the L ^ oo limit. These two assumptions are very natural. In a random system the ground state 
configuration is completely disordered. The fact that there are large-scale higher excitations indicates that there exist 
configurations very close in energy to the ground state energy but very far from each other in phase space. If the 
ground state configuration is suppressed from the set of allowed configurations the statistical properties of the new 
lowest gap E2 — El will remain the same to those of the original lowest gap Ei. Hence, any variable {v or E) appears 
' to be uncorrelated to the energy. Nevertheless, note that while energy levels are random, excitation volumes may be 
correlated among themselves. In a disordered system, the presence of random-energy levels extends to higher energy 
typical excitations supporting the core of the results presented in I. Obviously this is not true in an non-disordered 
system where the ground state may have a crystalline structure and typical excitations are not statistically represented 
by the lowest ones. The validity of this description in terms of a random-energy levels scenario is probably related 
to the stochastic stability property of disordered systemsQ. If the system is stochastically stable then we can perturb 
it with a random Hamiltonian without changing the physical properties of the system (for instance, the value of the 
thermal exponent 9). A slight perturbation of the original Hamiltonian corresponds to shift and mix the original 
distribution of energy levels. A good selection of the type of random perturbation and an appropriate tunning of its 
intensity might have the effect of making typical those lowest order excitations which originally were not. Because 
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the physical properties of the new perturbed system remain unchanged this impHes that the statistical properties of 
lowest and typical excitations must be also the same. 




To verify these assumptions we studied first and second excitations in the two dimensional Gaussian spin glass 
defined by 

7i = — ^ Jij (jj , (1) 

where the <7i are the spins (±1) and the Jy are quenched random variables extracted from a Gaussian distribution 
with zero mean and unit variance. In I we found that two exponents A and 9' characterize the level spectrum. A 
question not addressed in detail was the issue of correlations. Using the transfer matrix method we have looked at first 
and second excitations for 2D spin glasses with periodic-pgriodic (PP), free-free (FF) and free-periodic (FP) boundary 
conditions. Second excitations are also cluster excitationaj which strongly simplifies the analysis. Investigating higher 
energy levels requires larger computational effort but can be afforded. Sizes range from L = 4uptoL = 11 for PP and 

(s) (s) 

up to L = 14 for FP and FF. The typical number of samples is 10 for all sizes. Let ' and ^2 denote the volume of 

(s) (s) 

the first and second excitations with respective gaps , i?2 for a given sample s. We define the second-excitation 

(with energy gap E2) probability distribution P*-^-'(t!, E2) = g^'^\v) P^iP {E2) in analogous way as we did in I for first 
excitations. In figure IT] we show the probability to find a second excitation with volume v g^^\v) for the PP case (the 
other cases are similar) showing the same functional shape to that found in the case of the lowest first excitations. 
Also in that figure we show the average gap for second excitations compared to the first-excitation gap as function 
of L for PP and FF. We point out two important features: One the one hand, (/^^■'(w) follows the same functional 
form to the one describing first excitations with the same exponent A and tends to g{v) in the large volume limit. 
It is also remarkable that the distributions g{v) and g'^'^\v) are nearly equal, except from a small discrepancy in the 
single-spin excitations weight. The reason for this difference comes from the excluded volume effect arising from the 
single-spin first excitation which leaves a smaller volume V — 1 available to the second excitation. For small systems 
this implies a net decrease of the probability of having one-spin excitations whereas, larger volume second excitations, 

are insensitive to this effect. Furthermore, this effect yields important vi — V2 correlations. On the other hand, as 

" (2) 

was the case for for Py^{Ei), the energy distribution {E2) is independent of the size V2 of the second excitation. 
As expected we have that Pv'^\E2) = V^'^'^ {E2 / )■ Within numerical precision 9" = 9' for a given size. 

We now focus on the issue of the existence of correlations. Let us denote by Xg , j/s any two quantities for sample s 
and let us consider their corresponding correlation. 



^x,y\^) — I , ■ V^J 

We find that correlations between energies and volumes of the type C„(i) (i), whichever they are (first or second 
excitations, i.e. i,j = 1,2) asymptotically vanish in the L — > 00 limit (figure 2a). Correlations between the energies 
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of the levels deserve some comments. Since E2 > Ei there are trivial energy correlations. In this case it is convenient 
to consider correlations in taking x = Ai = Ei, y = A2 = E2 — E^. We see a slow but systematic decrease 
of Cai^AsC-^) with L suggesting there are no gap-gap correlations (figure 2b). Nevertheless correlations of the type 
Cvi,v2{L) are much higher and, although they saturate and show a tendency to decrease later, we have no evidence 
that they indeed vanish in the L 00 limit (figure 2c). 




Based on the evidence in favor of a random-energy levels scenario we derive a novel low-temperature expansion for 
spin glasses. This expansion has been partially discussed in several papers but, to our knowledge, has never been 
worked out in detail. The systematic procedure to built this expansion is as follows. Consider a spin-glass system 
described by a Hamiltonian Hj (a) where a denotes the set of discrete spin variables and J are the couplings that we 
take continuous in order to avoid accidental degeneracy of the ground state. Consider a given sample which we will 
denote by (s) and let us denote its different excited levels by the index r = 0, 1, 2, ... where r = denotes the ground 
state configuration, r = 1 the first or lowest excitation, r ~ 2 the second excitation and so on. 

The low-temperature expansion is done by fixing the "excited" level r and keeping in the partition function all 
first r levels plus the ground state configuration. The mathematical object in terms of which the expansion is 
written is the probability distribution V'^^^Ei, E2, Er,C{vi,V2, ■■,Vr)) where Ei is the gap of the i*'' excitation 
and C{vi,V2T-,Vr) stands for a set of variables including all excitation volumes Vi as well as some other volumes 
obtained by a given number of set operations (for instance, unions and intersections among the Vi). This set C of 
volume variables may be quite complex and strongly depend on the observable we are expanding. For r = 1 the 
appropriate probability is V^-'-'^ {Ei,vi) as considered in I. In practice, this procedure generates a low-temperature 
expansion in powers of T up to order T^. Including higher-order excitations in the partition function yields always 
higher order T corrections so the expansion is well defined. As an example, let us see how the expansion works 
for the spin-glass susceptibility XSG = V{q'^) up to order (g is the overlap between two replicas). In this case 
r = 2 and the probability is V^'^'^{Ei,E2,vi,V2,v) where w = ui U W2 — wi fl V2, so C{vi,V2) is the set of variables 
including each of the excitation volumes plus their total non-overlapping volume. This probability can be written 
as V^'^''{Ei, E2,vi,V2,v) = gy-^^y2^yPv'^}v2,v{Ei, E2) this last term being the conditioned probability for a given triplet 
vi,V2,v to have energy gaps Ei,E2- Therefore, if we keep only the first and second excitations in the Hamiltonian 
and we denote Xi = eyi\){—(3Ei), we get 



XSG = V 



T.y"«i(^-f'i) / dEi / dE2-,, 

Jo Je, {1+X1+X2) 



xirif{Ei,E2) 



a pCxD poo 

y^y^^V-V2) / dEi / dE2 

Jo Je, {l + xi+X2)^ 



X2Vif{Ei,E2) 
{\+Xi+X2Y 

XiX2V^^\Ei,E2) 



(3) 
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where we have defined PvT (Ei, E2) = X^aii v's except vi 'P^'^H^i, E2,vi,V2,v) where stands for vi,V2 or v. Expression 
can be worked out in the limit P ^ 00 yielding, after some lengthy calculations, 

vi vi 

E 0)^^(^ - «i) - 2 log(3/2) E T'if (0, 0)v2{V - V2) - log(4/3) V[^\0, Q)v{V - v)) + 0{T^) (4) 



where 'P^^^(£'i, wi) — d{E2)Pil\Ei, E2),'P^^\Ei,vi) = '^^ al;^^'"^^ ' ^^'^ these expressions appear evaluated at 
i?i = in (^). In (|^) we recognize the linear contribution in T presented in I. At first glance, this expansion looks 
too complicated to be useful. But as we will see below, it can be properly interpreted in a scenario of random-energy 
levels. 

One of the most striking consequences of the random-energy levels scenario is that it can be used to predict the 
specific heat exponent. There has been a lot of work to understand the specific heat anomaly in structural glasses 
showing that, in good approximation, specific heat is linear in T. This is usually explained by the fact that this 
kind of systems have a finite density of states at zero gapcl. Contrarily, in spin glasses the behavior of the specific 
heat at low-temperatures has not received much attention probably because the question (both from the numerical 
and experimental point of view) can be. hardly answered due to the difficulty to reach thermal equilibrium at low 
temperatures. Cheung and McMillanllJ claimed that the specific heat in 2D should be linear in T while Fisher 
and Husea made some observations about the sample to sample fluctuations of the ground state energy and its 
relation to the low-temperature specific heat. The specific heat is given by the usual fluctuation-dissipation formula, 
c = ^(< E"^ > — < E >^). Using the low-T expansion method discussed before we expand c up to any order in T. 

The calculations are less laborious than for XSG because the relevant probabihty functions ^^'''(£'1, i?2, ■■■,Er) do not 
depend on the spectrum of excitation volumes. If we expand up to order then we must consider only the two 
lowest-lying excitations in the Hamiltonian. This yields the following expression for the specific heat, 

frr T\ f°° ^ [°° ^ -0(2)^ exp(-/3xi) {xi - X2f exp(-^(a;i -|- X2)) + xj exp(-/3a:2) ^^ , , 

^y^^^l^TTl ^'^1/ dx2V^ >{xi,X2)[ , ^ , ^ ,,2 )■ (5 

y Jo Jx, ^ (l-|-exp(-/3a;i) -|-exp(-/3a;2)) ^ 

In the limit T — > after some calculations we obtain, 

7r2r^W(o) 9C{3)T'^V'(^){0) 0.77564 T^7?(^) (0, 0) 

where — J^kLi is the Riemann function and V'^^^E) — ^^^g^^- In general, it can be shown that the terms 
appearing in the expansion at order T'' are of the type, V Ei,..,e^'P^"HEi, ■■, E^) evaluated sX Ei = ,V« with u + v = r 
(the symbol V denotes all possible partial derivatives). 
According to the assumption A of the random-energy levels scenario the r-point energy probability distribution 

factorizes, i.e. V^''\Ei, E2, Er) = 111=1^1^^(^0 where afl the vI^\e,) scale with the size of the system L with 
the same exponent 9' , 

vI'\e,) = L~'V,{^) (7) 

and the dependence of the energy level i enters only through the scaling function P. The presence of the same 
exponent 9' for all levels is also a consequence of the random-energy levels scenario. Therefore, at order in the 
low-T expansion all terms scale like [TL^^ Y 1^ thus leading (since 9' < 0) to an apparent divergent series. The whole 
series can then be resumed in a singular function c{x), c{T,L) = ^c{TL~^ ) like in ordinary critical phenomena. In 
the scaling region T — > and TL~^ finite, we have a finite heat-capacity Vc{T,L). But if we take first the limit 
L — > c» and afterwords T the L dependence must disappear in the specific heat, therefore c{x) — > x^e^ when 
a; ^ 00 yielding c{T ^ 0) T" with a the specific heat exponent a = — jr. For Gaussian spin glasses in general 
dimensions there is a general argument (see I) supporting that 9' = — d, hence a = 1. Nevertheless, in I we showed 
how both exponents 9' and A suffer from very strong finite-size corrections yielding effective values for the exponents 
9' and a in the range of sizes L < 14: 9'^ff = —1.7 ± 0.1 and aeff — 1-18 ± 0.07. In figure 2 we show finite-temperature 
transfer matrix calculations for the 2D Gaussian spin glass in the same range of sizes L < 14 which nicely conform to 
this prediction (we tried the effective exponents 9'^^ = —1.6, acs — 1.25). Only when the system reaches a temperature 
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such that TL~^ is not too small (i.e. for pretty large sizes) we will obtain the right linear in T dependence. It is 
important to note that for finite systems c is always linear in T for low enough temperatures. Note that because 
9' <Q the exponent a is always positive. The calculation of the low-temperature specific heaUexponent a provides an 
indirect way to determine the gap exponent 6' . Preliminary investigations for the SK modeltll show that the effective 
gap exponent d/0' is well compatible with 2 giving the well know resulttHI a = 2. 



> 




FIG. 3. Heat capacity Vc{T,L) versus TL~^ {9' = —1.6) plotted in log-log scale for the FF case with different lattice sizes 
i = 6 — 14 (bottom to top on the right). We also show the asymptotic behaviors c{x ^ 1) ~ x^'^^ (full line) and c{x <C 1) ~ a; 
(dashed line). 

We discuss now the behavior of the XSG which is certainly more subtle. As observed in I, the linear term in T scales 
like VTL^^ but the first term of 0{T^) in expression (|^) scales like VT^L^^^^ . The rest of quadratic terms would 
also scale like VT'^L~^~^ if the three distributions g^^ , g^^ , gv {v — viUv2 ~ vi Ci V2) defined by P^. (E) = gviPvi [E) 
scale with the same exponent A. Indeed, we have seen that gv^ , gv2 are described by the same exponent A and we also 
verified that the same is true for the gv Therefore, to understand the character of the low-T expansion it is necessary 
to consider higher orders in T for xsG- The cubic term is more complex but can be also worked out. In this case, 
the third excitation must be included in the calculation and the gets contribution from the first, second and third 
excitations. The first and second excitation will yield terms of the type VT^L~^~'^^ , but the third excitation, since 
it can consist of two disconnected droplets, will yield terms of the type VT^L~'^^~^ . Therefore, at any order beyond 
the first one (r — 1) there will be terms of the type j^-ue-vO -^j^^j^ u + v — r, r > 1; u^v > Q. Resummation 
of this divergent series yields, xsg{T,L) — Vx{TL^^ ,TL^^ ). There are two divergent length scales, but since 
0' < 9 {9 = 9' + dX with A > 0) the leading scaling behavior is governed by the term TL~^ . In renormalization group 
language this assertion implies that the leading behavior is determined by the fixed point which has largest correlation 
length exponent. In the region T — > 0, L ~ T^/^, the term TL^^ diverges like L^~^ and the scaling behavior of thfij 
susceptibility is given by, xsg{T, L) = Vx{TL-^, 00). For L > T^/^ and T ^ this yields the usual low-T resultEil 
XSG ~ with 7 = — I . Sub- leading corrections are then expected for xsG because for a given temperature and 
finite L, even if we keep TL^^ finite, the second argument of the scaling function x systematically changes with L. 
Only for sizes large enough such that TL~^ ^ 1 data would collapse. Note that these finite-size corrections can 
be important \i 9' ^ 9 (i.e. A > 0) as happens in 2D. This explains the corrections-Qhtained for the susceptibility 
exponent 7 obtained from Monte Carlo or finite-temperature transfer matrix methodal3'E3o. Actually, in ID (where 
A = and 6' = 6*' = — 1) it can be shown that the scaling behavior for small sizes of the spin-glass susceptibility 
Xsg{T, L) = LxiTL) is nearly perfect. 

To summarize, we have shown the numerical evidence in support of random-energy levels and derived a low- 
temperature expansion for spin glasses by progressively including higher excitations into the partition function. The 
coefficients in this expansion can then be written in terms of a set of energy gap probability distributions and their 
derivatives evaluated at zero gap. In particular, we have obtained the specific heat exponent (c T~'iP') which is 
linear under the assumption 9' = —d valid for Gaussian spin glasses in finite dimensions. It remains to be seen how 
3d spin glasses fit to the new scenario and how to extend these ideas to ± J spin glasses. 
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